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@ Optical position and orientation measurement techniques. 

© A non-contact sensing system for monitoring the posi- 
tion and orientation of a rigid body in space having at least 
three distinct point light sources mounted thereon. At least 
two position sensor heads (5,7) are fixedly mounted within 
detection range of light from the light sources, each position 
sensor head having a position sensitive detector. The lights 
are illuminated one at a time and in sequential arrangement 
and a processor (15) computes the position in three-dimen- 
sional space of an illuminated light source with data provided 
simultaneously by both position sensitive detectors. The pro- 
cessor also computes the position of the object in all six 
degrees of freedom using the three-dimensional positional 
data of all three light sources. 
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The invention relates to a non-contact 
sensing system for monitoring the position and 
orientation of a rigid body in space. More specific- 
ally, the invention relates to such a system which can 
monitor the position and orientation of a pilot's 
helmet within the cockpit of a high performance 
tactical aircraft simulator. 



In order for aircraft simulators to provide 
a realistic simulation of aircraft flight, it is 
necessary to display a simulated surrounding environ- 
ment to the simulator pilot. In currently available 
15 flight simulators, the displays are provided on the 

windscreens in the cockpit areas. Tfrese systems 
require one CRT for each such windscreen. With such 
a system, images of equal quality must be generated 
in each CRT regardless of where the pilot is looking. 
This is costly both in terms of hardware and computer 
time* 

However, by projecting the image directly 
onto the visor of a pilot's helmet, a significant 
cost saving can be realized since the field of view 
is greatly reduced so that both the quality of the 
image (i.e. resolution) and the frame rate can be 
reduced. The field of view would be head slaved in 
order to provide an image which is instantaneously 
limited to the pilot's viewing area but which can 
be redirected to permit the pilot to "look" in any 
direction. It is also contemplated to track eye 
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position or point of regard and provide a higher 
resolution image slaved to the eye's fovea! area. 
In such a system, the pilot would perceive high 
resolution imagery wherever he loo)ts . However, at 
any instant , the system is only required to produce 
high resolution images over a 15° cone. 

One of the difficulties associated with the 
use of helmet mounted visor displays is the maintenance 
of image stability. In order for the computer generated 
image to appear stationary as the pilot moves his head, 
the position of the pilot 1 s helmet must be known 
relative to the simulator ' s fixed axis. This position 
is defined by three translation parameters (X, Y, 2) 
and three rotation parameters (Euier Angles). This 
information is also necessary in order to align the 
computer generated image with the frame of the wind- 
screen. Thus, a (helmet) position sensing system is 
needed. 

Currently available non-contact position 
sensing systems comprise a magnetic system as described 
in Raab, F.H. , Blood, E.B. , Steiner , T.O. , and Jones, 
H.R. , "Magnetic Position and Orientation Tracking 
System* , IEEE Transactions on Aerospace and Electronic 
Systems . Vol. AES— 15 , No. 5, September 1979, pp. 
709-718, and a V-slit system as described in Lewis, 
C.J.G. , "Helmet Mounted Display and Sight Develop- 
ment* , Proceedings of the American Helicopter Society , 
May 1979, pp. 79. 17. 1-79. 17.13. However, both of 
these systems, fail to meet required specifications. 
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It is therefore an object of the invention 
to provide a non-contact position sensing system which 
meets the required specifications. 

In accordance with the invention, the system 
monitors the position orientation of a tody in space 
which has at least three distinct point light sources 
mounted thereon. The system includes at least two 
position sensor heads each of which includes a 
position sensitive detector. 

The invention will be better understood by 
an examination of the following description, together 
with the accompanying drawings, in which: 

FIGURE 1 is a schematic diagram of the 

inventive system; 
FIGURE 2 A is a schematic diagram of a 

position sensitive detector; 
FIGURE 2B is an electron flow diagram of 

the position sensitive detector; 

and 

FIGURE 3 illustrates an analog position 

processing circuit for processing 
data of the position sensitive 
detector. 

Referring to Figure 1, 1 is a rigid object 
in space whose position, and orientation must be 
monitored. In the particular embodiment illustrated, 
1 is a helmet which is worn by a pilot in the cockpit 
of a high performance tactical aircraft simulator. 
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A mounting plate 3 carries at least three 
point light sources, preferably LED 1 s, and the mounting 
plate is mounted on the helmet. Obviously, the LED* s 
could be mounted directly on the helmet instead of on 
a mounting plate. 

Fixedly mounted in the cockpit are position 
sensor heads 5 and 7. The sensor heads are mounted 
within detection range of the light from the LEDs, 
and are -directed at the LEDs. Camera lenses 6 and 
8 are disposed in front of the position sensor heads 
for reasons explained below. 

As the position sensor head is sensitive to 
a wide spectrum of light, bandpass interference filters, 
illustrated schematically at 9 and 11, are placed in 
front of each lens to minimize the effect of ambient 
light. TEhe filters aire spectrally matched to the 
light of the LEDs. 

Bach position sensor head includes a position 
sensitive detector which will be discussed in asso- 
ciation with Figures 2 and 3 below. 

The output of each position sensor head is 
fed to an analog- to— digital converter 13, and the 
digital data is then fed to a computer 15. One output 
of 15 is fed to a controller 17 which provides a host 
computer with the position and orientation information 
of the h elm et as computed in the computer. 

As is known, and will be discussed below, 
at least three LEDs coupled with two position sensor 
beads are needed to determine the position and 
orientation of the helmet in all six degrees of 
freedom. In accordance with the invention, the 
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LEDs are illuminated one at a time, and in sequential 
arrangement, and tlie three di men sional position of 
each is determined by a triangulation scheme 

using the data from the two position sensor heads. 

It is also necessary to maintain a constant 
light intensity of each LED regardless of the position 
or orientation of the helmet. 

LED controller 19 maintains a constant light 
intensity of the LEDs and also illuminates the LEDs 
one at a time and in sequential arrangement. As can 
t>e seen, the controller 19 is controlled by the com- 
puter 15 which determines the required LED current to 
maintain a constant light intensity as a function of 
the position of the helmet. The computer also selects 
the particular LED to be illuminated, and takes into 
account the fact that it was this LED illuminated when 
computing the position and orientation of the helmet. 

Turning now to Figures 2A and 2B, as can be 
seen, the position sensitive detector is a planar 
photodiode 21 with very uniform resistive layers 
formed over both the top and bottom surfaces. The 
camera lenses 6 and 8 are used to focus the infrared 
light from the LEDs onto the active area of this 
detector. 

This results in the generation of electron- 
hole pairs in the depletion layer directly under the 
light spot. The electrons migrate to the N-layer 
where .they are channelled between two electrodes. 
Since the N-layer has a uniform resistivity, the 
current flowing to the pair of Y electrodes will 
depend on its distance from the point of incidence 
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of the light. 

The saae basic principles apply to the 
P- layer, i.e., boles will migrate to the F- layer. 
The current signals are then processed using, for 
ea campl e, the circuitry illustrated in Figure 3. 

Turning now to Figure 3 r the processing 
circuit comprises preamps 23 connected to each one 
of the X and Y electrode pairs. Adders 25A add the 
contents of the X electrodes and adders 25B add the 
contents of the Y electrodes. Subtracters 27A sub- 
tract the contents of the X electrodes and sub- 
tractors 27B subtract the contents of the Y electrodes. 
5ne outputs of 25A and 27A are fed to background 
cancellation circuits 29 A and the outputs of 25B 
and 27B are fed to background cancellation circuits 
29B, and the outputs of cancellation circuits 29 A and 
29B are fed to dividers 31A and 3 IB, respectively. 

With filtering, as per filters 9 and 11, the 
resolution of the position sensor head can be as high 
as 0.02% of full scale. The filtering is necessary 
because of the high frequency jitter which is normally 
present. With the dynamic performance of the inventive 
device, it can be used for vibration measurements at 
frequencies of up to SO kHz. 

It is necessary to use two sensors viewing 
the same LED patterns (at least three LEDs) to uniquely 
determine the helmet position in all six degrees of 
freedom. The image on the sensitive area of the 
detector of each LED is a two-dimensional perspective 
projection of an LED moving in three-dimensional space. 
Consequently, the thr ee-dimens ional position of the LED 
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cannot be recovered from its image coordinates. At 
best, only the direction of the vector between the 
LED and the sensor can be determined. If each LED 
is viewed from two locations, a triangulation scheme 
can be used to compute the position of each LED in 
three dimensions. Therefore, with a minimum of three 
LEDs and two sensors, the helmet position can be 
uniquely determined in all six degrees of freedom. 

The addition of more LEDs results in an 
overdetermined system of equations which can increase 
the accuracy of the measurement through the appli- 
cation of least squares analysis as taught in Roach, 
J.w. and Aggarwal, J.K. , "Determining the Movement of 
Objects from a Sequence of Images" , IEEE Transactions 
on Pattern Analysis and Machine Intelligence , Vol. 
PAMI-2, No. 6, November 1980, pp. 554-562. 

Data processing tasks for the optical helmet 
position sensing systems are accomplished, in one 
embodiment, by an INTEL iSBC 86/12 single board com- 
puter. This Board's, capabilities are summarized as 
follows : 



CPU 


8086 


CPU SPEED 


5MHz 


RAM (BASE BOARD) 


32 K 


EPROM (BASE BOARD) 


16 K 


SERIAL I/O 


1 


PARALLEL I/O LINES 


24 


TIMERS 


2 


INTERRUPTS 


8 
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In order to determine the helmet position and 
orientation, a large number of floating point operations 
must be performed. Several trigometric functions are 
also required. The floating point operations can be 
performed by the 8087 Numeric Processor. The 8087 
has the ability to perform the "high speed floating 
point mathematics required in complex control 

algori tbms . 

Helmet position and orientation data are, as 
above— mentioned , transferred from the computer to a 
host computer. In the preferred embodiment, the trans- 
fer from the INTEL 86/12 is to a SEX 32/55 host com- 
puter. In this embodiment, the control 17 comprises 
a MULTXBUS-SELBUS Controller (MBSEL). The MBS EL board 
15 i s an intelligent DMA controller which communicates 

with the SESJBXJS via a nigh speed data interface board 
(BSD). Because of the 86/12 board *s dual port RAM, 
the MBSEI* r"T»re access the position and orientation 
data directly via the MULTIBUS . Data transfers are 
20 transparent to both the SEX and 8086 processors. 

Again, in the particular embodiment, a 
cnis torn— built analog board 13 is used to read the out- 
put signals from the position sensor beads and to 
convert them into digital signals. In order to 
25 minimize the conversion time, two independent 14- bit 

analog— to— digi tal converters were included on this 
board. 

Methods for the mathematical analysis of 
the data are taught in, for example, Lenox, J.B., 
Six Degree oZ Freedom Human Eveball Movement Analysis 
Involving Steriometric Techniques , Ph.D. Thesis, 
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Stanford University, Stanford, California, 1976, 
Schut, G.H, , "On Exact Linear Equations for the 
Computation of the Rotational Elements of Absolute 
Orientation", Photoarammetria , Vol. 17, No. 1, I960, 
pp. 34-37, Schut, G.H. , "Formation of Strips from 
Independent Models" , AP-PR 36. NRC-9695 . Division of 
Physics, National Research Council of Canada, Ottawa, 
July 1967, and Thompson, E.K. , "An Exact Linear 
Solution of the Problem of Absolute Orientation" , 
Photoarammetria , Vol. 15, No. 4, 1959, pp. 163-179. 

In comparison with other n on— contact 
position sensing systems, the inventive system offers 
high resolution and speed at a relatively low cost. 
These features suggest other possible applications of 
the invenrive system in the areas of robot vision, 
industrial control, kinesiology and laboratory 
instrumentation. Accordingly, the inventive system 
has uses outside of the environment as described 
above in the preferred embodiment. 

Although a particular embodiment has been 
described, this was for the purpose of illustrating, 
but not limiting, the invention. Various modifi- 
cations, which will come readily to the mind of one 
skilled in the art, are within the scope of the 
invention as defined in the appended claims. 
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1. a non-contact sensing system for monitoring 

the position and orientation of a rigid body in space 
wherein at least three distinct point light sources 
are mounted on said body for movement therewith; 
system comprising r 

at least two position sensor heads fixedly 
mounted within detection range of light from said 
light sources, said position sensor heads being 
directed at said light sources: 

characterized in that each position sensor 
head includes a position sensitive detector; 

aeans for illuminating said light sources 
one at a ^-imp and in a sequential arrangement 7 

processor means; 

said position sensitive detector outputs 
being connected to the input of said processor means; 

said processor means being adapted to com- 
pute the position in three-dimensional space of an 
illuminated light source with data concerning said 
illuminated light source provided simultaneously by 
both position sensitive detectors; 

said processor means also being adapted to 
compute the position of said object in all six degrees 
of freedom using the three— dimensional positional 
data of all three light sources. 
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2 m a system as defined in claim 1 wherein said 

position sensitive detectors provide analog signals 

at their outputs; 

analog- to-digital conversion means between 
the outputs of said position sensitive detectors and 
the input of said processing means whereby to convert 
said analog signals into digital signals for use in 
said processor means. 

3^ a system as defined in claim 2 and including 

means for varying power to said light sources whereby 
to maintain a constant light intensity from each light 
source at said position sensitive detectors regardless 
of the position and orientation of said rigid body. 

4 _ a system as defined in claim 3 and further 

including lens means on each position sensor head 
whereby to focus light from said light sources onto 
a respective position sensitive detector. 

5, a system as defined in claim 4 and including 
filter means on each lens, the filter means being 
spectrally matched to the light sources. 

6, A system as defined in claim 5 wherein said 
rigid body comprises a pilot's helmet within the cock- 
pit of an aircraft simulator; 

said position sensor heads being mounted 
in the interior of said simulator. 

j m a system as defined in claim 6 wherein said 

light sources comprise LEDs, said means for varying the 
light intensity comprising means for varying the current 
to said LEDs. 



0162713 



6. A rion-contacrt method for monitoring the 

position and orientation of a rigid body in space 
baving at least tbree distinct point light sources 
mounted thereon for movement therewith; 

at least two position sensor heads fixedly 
mounted within detection range of light from said 
light sources, each position sensor head including 
a position sensitive detector, said position sensor 
beads being directed at said light sources: 

and a processor means; 

said method comprising: 

illuminating said light sources one at a 
i-i'mp and in sequential arrangement; 

computing, by said processor means, the 
position in three-dimensional space of an illuminated 
light source with data concerning said illuminated 
light source provided simultaneously by both position 
sensitive detectors to said processor means: 

computing the position of said object in 
all six degrees of freedom using the three-dimensional 
positional data of all three light sources. 
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